Fall 2019, Stat 426 : Homework 1 

Moulinath Banerjee 

University of Michigan 

Announcement: The homework carries 65 points and is due on Sep 27. 
Time and place for turning in HW to be announced later. 

1. Consider a population of size N of individuals marked {1,2,..., N} where 
the V th individual has a trait that is labeled as 0, 1 or 2 (for example, 
these could be stages of a medical condition). Let po,p\ and p 2 be the pro¬ 
portions corresponding to these three traits: thus po = Nq/N where Nq of 
the N individuals has trait 0, and so on and so forth. Consider a random 
sample of size n drawn without replacement from this population, and let 
Xi denote the value of the trait for the Pth individual in the sample. Let 
ni = Ya =i 1 {Xi = 1) for Z = 0,1, 2. Thus no is the number of individuals in 
the sample with trait 0 and so on and so forth. Write pi = ni/n. 

(a) Argue that pi is a reasonable estimate of pi. Calcuate the mean and 
variance of pi. 

(b) Find an explicit formula for P(Aj 1 = e\,Xi 2 = e 2 ,.. .,Xj fc = e jf) for 
some k < n and i\ < 12 < ■ ■ ■ < ik, hi terms of po,pi,p 2 , X, so, si, S 2 where 
si is the number of e/s that equal l. 

(c) Find the covariance between po and p \. How does it compare to the 
covariance between fio and p\ in the case that Ai, X 2 ,..., X n are sampled 
WITH replacement? [7 + 8 + 10 = 25 points] 

2. A geometric random variable W takes values {1, 2, 3, . . .} and P(W = 
j ) = 9( 1 — O ')!- 1 ,where 0 < 9 < 1. 

(a) Prove that for any two positive integers i, j, it is the case that, P(W > 
i + j\W >i) = P{W > j ) . 

(b) Indeed, the converse is also true. We show that if W is a discrete ran¬ 
dom variable taking values {1,2,3, . . .} with probabilities {pi,P 2 ,P 3 , 

. . .} and satisfies the memory less property, then W must follow a 
geometric distribution. 

Follow these steps to establish the fact that W is geometric. Using the 
fact that W has the memoryless property, show that 

P(W >m) = (. P(W > l)) m , 

for any m > 2. As a first step towards proving this show that 
P{W > 2) = (P(W > l)) 2 
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Define 9 = P(W = 1) and 1 — 9 = P(X > 1). You now have, 

P(W > m) = (1 - ey n , 

for any m > 2. Use this to show that for any m > 2, 

p(w = m) = e( 

But for m = 1, certainly 

P(W = m) = P(W = 1) = 9 = 9{1 - 9) m ~\ 
and the proof is complete. (10 points) 

3. Let T be an exponential random variable with parameter (3 and let W be a 
random variable independent of T which assumes the value 1 with probabil¬ 
ity 2/3 and the value -1 with probability 1/3. Find the density of X = WT. 


Hint: It would help to split up the event {X < x} as the union of {X < 
x,W = 1} and {X < x, W = —1} . (10 points) 

4. Let X be an Exp(l) random variable. Let [X] denote the largest integer not 
exceeding X. Show that 

P([X] =m,X— [X] <t) = e~ Xm (l - e ~ xt ). 

Work out the marginals of [Y] and X — [X] and deduce that these two 
random variables are independent. (10 points) 

5. (a) (a) If X\ and X -2 are independent Poisson random variables with pa¬ 

rameters Ai and A 2 , then show that X\ + X 2 is also Poisson with 
parameter Ai + A 2 - Recall that if W follows Poisson($), then the p.m.f. 
of W is, 

P(W = m ) = ^p 

Hint: Write P(X 1 + X 2 = m) as YIILq = i, X 2 = m — i) and 
proceed. (5 points) 

(b) Use this result repeatedly to show that if Xi, X 2 , —,X n are 
independent Poisson random variables with parameters Ai, A 2 ,A n 
respectively, then X\ + X 2 + ... + X n follows Poisson with parameter 
Ai + A 2 + ... + A n . (5 points) 
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(c) Show from first principles that the conditional distribution of the 
random vector {X\, X 2 ,X n ) given that the sum 
X\ + X 2 + ... + X n = K for some integer K follows the multinomial 
distribution with parameters (K,pi,p 2 , ■■■,p n ) where each pi is given 
by 1 A ■ (10 points) 


3 



